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SERVICE PROVIDING SYSTEM, MANAGEMENT TERMINAL, MOBILE MEMBER, 
SERVICE PROVIDING PROGRAM, AND SERVICE.PROVIDING METHOD 



BACKGROUND OF THE INVENTION 

1. Field of Invention 

[0001] The present invention relates to systems, terminals, mobile members, 
programs, and methods which associates service with a virtual object, disposes the virtual 
object in a virtual space associated with an actual space, and provides service according to a 
positional relationship between a mobile member, such as a portable telephone, and the 
virtual object. More particularly, the present invention relates to a service providing system, 
a management terminal, a mobile member, a service providing program, and a service 
providing method which allow the user to easily receive service, which allow the user to 
receive not only information providing service but a variety of services, and which can 
flexibly handle a change in condition. 

2. Description of Related Art 

[0002] As systems for providing information according to the movement of the 
user, there have been conventionally known, for example, an information providing device 
(hereinafter called a first conventional case) disclosed in Japanese Unexamined Patent 
Publication No. Hei-10-13720, and a head-mount display apparatus (hereinafter called a 
second conventional case) disclosed in Japanese Unexamined Patent Publication No. 2000- 
152125. 

[0003] In the first conventional case, detection sections can detect the location and 
direction of a camera by a global positioning system (GPS), and the user can specify an 
object in an image displayed on a display or finder. A control section obtains the location 
information of the specified object by calculation, according to the specified location, and the 
detected location and direction, takes out the attribute data corresponding to the object from a 
map-data storage section by using the obtained location information, and displays on the 
display or finder or output after sound synthesis. Therefore, the attribute data of the object in 
the displayed image can be easily obtained and shown to the user. 

[0004] In the second conventional case, an icon image can be displayed on an 
image output section at a position corresponding to the line of sight detected by a line-of- 
sight detection section, by an input from an operation input section. To an eye of an operator, 
the icon image overlaps an actual field of sight seen from a window section. The operator 
moves the line of sight to a desired position in the field of sight, and fixes it by an instruction 



from the operation input section. For example, when a text actually located in front of the 
user is observed and a certain area is specified in the text, a sentence or word in the specified 
area is read by an image processing section from image information input from a CCD 
camera section, translated into a desired language, and displayed on the image output section. 

[0005] Therefore, an object in an actual field of sight can be selected and specified 
by the movement of the line of sight of the operator, and image information in the field of 
sight can be processed by using the line of sight as an input device. 

[0006] In the first conventional case, when the user specifies an object in an image 
displayed on the display or finder, the attribute data of the object is provided. Therefore, 
even when an object associated with attribute data effective to the user exists close to a 
location where the user is currently located, however, unless the user actively moves, the user 
cannot obtain the effective attribute data. 

[0007] In addition, since attribute data is provided for the user, the user can only 
obtain a service of receiving information. For example, a demand of the user for printing the 
content of the attribute data associated with an object on site can be difficult to achieve. Of 
course, it is possible that the attribute data is stored in a memory and the attribute data is 
printed later at a printer placed at the home of the user, however, this is not very convenient 
and the demand for printing the data on site cannot be satisfied. 

[0008] Further, since the user or an administrator cannot generate, delete, or update 
an object or attribute data, it can be very difficult when the system is applied to a new object, 
such as a building or to an object only temporarily located at a place, such as an exhibition, or 
when the users transfer information to and from each other. When a case in which users 
transfer information to and from each other is taken as an example, if a user makes a 
comment on a picture in an art museum in the first conventional case, for example, it is 
impossible for another user to browse the comment as attribute data when the another user 
stands in front of the same picture on another day. 

[0009] Also in the second conventional case, in the same way as in the first 
conventional case, since translation is performed when the user observes a text placed in front 
of the user and specifies an area in the text, unless the user actively performs an action, the 
user cannot receive a service of translation, in the same way as in the first conventional case. 

[0010] In addition, since a translated text is provided for the user, the user can 
obtain only information providing service as in the first conventional case. 
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SUMMARY OF THE INVENTION 
[0011] The present invention has been made in consideration of the unsolved issues 
included in the conventional technologies. It is an object of the present invention to provide a 
service providing system for dynamically providing service for movement, a management 
terminal, a mobile member, a service providing program, and a service providing method 
which allow the user to easily receive service, which allow the user to receive not only 
information providing service but a variety of services, and which can flexibly handle a 
change in condition. 

[0012] To achieve the foregoing object, a service providing system of the present 
invention is a service providing system for associating service with a virtual object, for 
disposing the virtual object in a virtual space associated with an actual space, and for 
providing service corresponding to the virtual object according to a positional relationship 
between a movable mobile member and the virtual object. The present invention can include 
a storage device for associating object information related to the shape and location of the 
virtual object with service information specifying a service content and for storing them, and 
a location-information acquisition device for obtaining location information used for 
identifying the location of the mobile member. When it is determined according to the 
location information obtained by the location-information acquisition device and the object 
information stored in the storage device that the mobile member is disposed in the inside area 
of the virtual object identified by the shape and location of the virtual object, service 
corresponding to the virtual object is provided according to the service information stored in 
the storage device. 

[0013] With such a structure, the location-information acquisition device can obtain 
location information, and it is determined according to the obtained location information and 
the object information stored in the storage device whether the mobile member is disposed in 
the inside area of the virtual object identified by the shape and location of the virtual object. 
As a result, when it is determined that the mobile member is disposed in the inside area of the 
virtual object, service corresponding to the virtual object is provided according to the service 
information stored in the storage device. 

[0014] Also, with such a structure, a virtual object has a logical shape and a location 
in a virtual space associated with an actual space. The shape may be, for example, a sphere 
having the center at the location and a radius of about 1 m, or may be a cube having the 
center at the location and a side length of about 1 m. Alternatively, the shape can be any 
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shape, including a shape obtained by imitating a natural thing or a living thing. Of course, 
the shape is not limited to a three-dimensional shape, and may be a plane shape. 

[0015] Therefore, since an area where service is provided is relatively clarified, 
different services can be provided in fine units, such as in units of several meters. In 
addition, since an area where service is provided is not a point but has a predetermined range, 
the user is more likely to receive the service. The same points are applied to service 
providing programs and to service providing methods which has above structure. 

[0016] Further, the mobile member may be a mobile member in the actual space, or 
may be that in a virtual space. In the former case, a portable telephone or a vehicle 
corresponds to the above mobile member. When the present invention is applied to a 
portable telephone or a vehicle, for example, service can be provided according to the 
location of the user. In the latter case, a mobile member on a computer simulation or a 
mobile member in a game corresponds to the above mobile member. When the present 
invention is applied to a computer simulation, service can be provided according to the 
location of a mobile member in a virtual space. The same points can be applied to service 
providing systems, to a mobile member, service providing programs, and service providing 
methods. 

[0017] Further, provided service can include any service, and is not limited to 
information providing service. It may be, for example, service implemented by operating a 
mobile member or another apparatus, and may be service for giving the users a 
predetermined benefit, such as discount. The same points are applied to service providing 
systems, service providing programs, and service providing methods. 

[0018] Further, the storage device can store object information with the use of any 
technique at any time. The storage device may store object information in advance. 
Alternatively, the storage device may store object information by an external input while the 
apparatus is operating, without storing the object information in advance. 

[0019] This is also applied to storage of service information. The same points can 
be applied to service providing systems, to a management terminal, to service providing 
programs, and to service providing methods. 

[0020] Further, the present system may be implemented as a single apparatus, or 
may be implemented as a network system in which a plurality of terminals are connected in a 
communication-allowed manner. In the latter case, each component needs to be connected in 
a communication-allowed manner. Each component may be connected to any of the plurality 
of terminals. The same points cab be applied to service providing systems. 
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[0021] Further, for example, the location-information acquisition device may obtain 
location information by measuring the location of the mobile member by the use of a 
communication terminal to which the mobile member is connected in a communication- 
allowed manner. The location-information acquisition device may obtain location 
information by measuring the location of the mobile member in the mobile member with the 
use of a GPS, or by a calculation performed by the communication terminal according to 
measurement information sent from the mobile member. The location-information 
acquisition device may obtain location information by measuring the location of the mobile 
member in a base station connected to the mobile member, or by a calculation performed by 
the communication terminal according to measurement information sent from the base 
station. As an example system in which the mobile member and the above-described 
communication terminal are used in combination, a system using a radio-frequency 
identification (RFID) can be used. More specifically, a non-contact-type tag from which the 
tag ID can be read in a non-contact manner is attached to the mobile member, and tag-ID 
reading device for reading the tag ID of a non-contact-type tag from the tag in a non-contact 
manner is provided for the communication terminal. When the communication terminal 
detects the mobile member by the use of the tag-ID reading device, the location-information 
acquisition device obtains the position of the communication terminal as the location 
information of the mobile member. In this case, the communication terminal itself can serve 
as tag-ID reading device. The same points are applied to service providing systems, to the 
mobile member, to service providing programs, and to service providing methods. 

[0022] Further, a service providing system according to the present invention is a 
service providing system above, wherein the mobile member and a management terminal for 
managing the virtual object are connected in a communication-allowed manner. Here, the 
mobile member has the location-information acquisition device, and sends the location 
information obtained by the location-information acquisition device to the management 
terminal. The management terminal has the storage device, and when the management 
terminal receives the location information, it determines according to the received location 
information and the object information stored in the storage device whether the mobile 
member is disposed in the inside area of the virtual object identified by the shape and location 
of the virtual object. 

[0023] With such a structure, the mobile member obtains location information from 
the location-information acquisition device, and sends the obtained location information to 
the management terminal. 
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[0024] When the management terminal receives the location information, the 
terminal can determine according to the received location information and the object 
information stored in the storage device whether the mobile member is disposed in the inside 
area of the virtual object identified by the shape and location of the virtual object. 

[0025] Service can be provided at any place. An entity which provides service is 
not limited to the management terminal. The mobile member or another apparatus may 
provide service. When the management terminal provides service, for example, if it is 
determined that the mobile member is disposed in the inside area of a virtual object, the 
management terminal needs to provide service corresponding to the virtual object according 
to the service information stored in the storage device. When the mobile member provides 
service, for example, the management terminal sends a result of determination and service 
information corresponding to the virtual object, stored in the storage device to the mobile 
member, the mobile member receives the result of determination and the service information, 
and if the received result of determination indicates that the mobile member is disposed in the 
inside area of the virtual object, the mobile member needs to provide service corresponding 
to the virtual object according to the received service information. 

[0026] Further, a service providing system according to the present invention is a 
service providing system above, wherein the mobile member and a management terminal for 
managing the virtual object are connected in a communication-allowed manner. The 
management terminal has the storage device, and sends the object information stored in the 
storage device to the mobile member. The mobile member has the location-information 
acquisition device, and when the mobile member receives the object information, it 
determines according to the location information obtained by the location-information 
acquisition device and the received object information whether the mobile member is 
disposed in the inside area of the virtual object identified by the shape and location of the 
virtual object. 

[0027] With such a structure, the management terminal sends object information 
stored in the storage device to the mobile member. 

[0028] The mobile member obtains location information by the use of the location- 
information acquisition device. When the mobile member receives object information, it 
determines according to the location information and the received object information whether 
the mobile member is disposed in the inside area of the virtual object identified by the shape 
and location of the virtual object. 
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[0029] Service can be provided at any place. An entity which provides service is 
not limited to the mobile member. The management terminal or another apparatus may 
provide service. When the mobile member provides service, for example, the management 
terminal sends object information stored in the storage device and the service information 
corresponding thereto to the mobile member, the mobile member receives the object 
information and the service information, and if a result of determination indicates that the 
mobile member is disposed in the inside area of the virtual object, the mobile member needs 
to provide service corresponding to the virtual object according to the received service 
information. When the management terminal provides service, for example, the mobile 
member sends a result of determination to the management terminal, the management 
terminal receives the result of determination, if the received result of determination indicates 
that the mobile member is disposed in the inside area of a virtual object, the management 
terminal needs to provide service corresponding to the virtual object according to the service 
information stored in the storage device. 

[0030] Further, a service providing system according to the present invention is a 
service providing system above, wherein, when the result of the determination indicates that 
the mobile member is disposed in the inside area of the virtual object identified by the shape 
and location of the virtual object, the management terminal provides service corresponding to 
the virtual object according to the service information stored in the storage device. 

[0031] With such a structure, when the result of the determination indicates that the 
mobile member is disposed in the inside area of the virtual object identified by the shape and 
location of the virtual object, the management terminal provides service corresponding to the 
virtual object according to the service information stored in the storage device. 

[0032] Further, a service providing system according to the present invention is a 
service providing system above, wherein the management terminal sends the service 
information stored in the storage device to the mobile member, and when the result of the 
determination indicates that the mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual object, the mobile member provides 
service corresponding to the virtual object according to the received service information. 

[0033] With such a structure, the management terminal sends service information 
stored in the storage device to the mobile member. 

[0034] When the result of the determination indicates that the mobile member is 
disposed in the inside area of the virtual object identified by the shape and location of the 
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virtual object, the mobile member provides service corresponding to the virtual object 
according to the received service information. 

[0035] Further, a service providing system according to the present invention is a 
service providing system above, wherein the management terminal further includes an input 
device for performing an input related to generation, deletion, or update of the object 
information, and object-information processing device for generating, deleting, or updating 
the object information according to the content of the input performed by the input device. 

[0036] With such a structure, when the input device can perform an input related to 
generation, deletion, or update of object information, the management terminal generates, 
deletes, or updates the object information according to an input content by the use of the 
object-information processing device. 

[0037] The input device can allow a direct input to the management terminal. It 
may allow an input through communication with the mobile member or another apparatus. 

[0038] Further, a service providing system according to the present invention is a 
service providing system above, wherein the service information is operation information 
specifying the content of an operation of the mobile member or another apparatus, and when 
it is determined that the mobile member is disposed in the inside area of the virtual object 
identified by the shape and location of the virtual object, the mobile member or the another 
apparatus is operated according to the operation information corresponding to the virtual 
object, stored in the storage device. 

[0039] With such a structure, when it is determined that the mobile member is 
disposed in the inside area of the virtual object identified by the shape and location of the 
virtual object, the mobile member or the another apparatus is operated according to operation 
information corresponding to the virtual object, stored in the storage device. 

[0040] Further, a service providing system according to the present invention is a 
service providing system above, wherein the service information specifies the content of 
service in which media information related to characters, images, or video is provided for the 
mobile member, and when it is determined that the mobile member is disposed in the inside 
area of the virtual object identified by the shape and location of the virtual object, the media 
information is provided for the mobile member according to the service information 
corresponding to the virtual object, stored in the storage device. 

[0041] With such a structure, when it is determined that the mobile member is 
disposed in the inside area of the virtual object identified by the shape and location of the 
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virtual object, media information is provided for the mobile member according to service 
information corresponding to the virtual object, stored in the storage device. 

[0042] Further, a service providing system according to the present invention is a 
service providing system above, wherein the service information specifies the content of 
service in which notice information related to a notice or guidance information related to a 
guidance is provided for the mobile member, and when it is determined that the mobile 
member is disposed in the inside area of the virtual object identified by the shape and location 
of the virtual object, the notice information and the guidance information are provided for the 
mobile member according to the service information corresponding to the virtual object, 
stored in the storage device. 

[0043] With such a structure, when it is determined that the mobile member is 
disposed in the inside area of the virtual object identified by the shape and location of the 
virtual object, notice information and guidance information are provided for the mobile 
member according to service information corresponding to the virtual object, stored in the 
storage device. 

[0044] Further, a service providing system according to the present invention is a 
service providing system above, wherein the mobile member is a portable terminal. 

[0045] With such a structure, the portable terminal obtains location information by 
the use of the location-information acquisition device. The portable terminal or the 
management terminal determines according to the obtained location information and the 
object information stored in the storage device whether the mobile member is disposed in the 
inside area of the virtual object identified by the shape and location of the virtual object. 

[0046] Further, a service providing system according to the present invention is a 
service providing system for associating service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, and for providing service 
corresponding to the virtual object according to a positional relationship between a movable 
mobile member and the virtual object. The present invention can include a storage device for 
associating object information related to the virtual object with operation information 
specifying the content of an operation of the mobile member or another apparatus, and for 
storing them. When it is determined according to the object information stored in the storage 
device that the positional relationship between the mobile member and the virtual object 
satisfies a predetermined condition, the mobile member or the another apparatus is operated 
according to the operation information corresponding to the virtual object, stored in the 
storage device. 
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[0047] With such a structure, it is determined according to the object information 
stored in the storage device whether a positional relationship between the mobile member and 
the virtual object satisfies a predetermined condition. 

[0048] As a result, when it is determined that the predetermined condition is 
satisfied, the mobile member or the another apparatus is operated according to operation 
information corresponding to the virtual object, stored in the storage device. 

[0049] Also, with such a structure, the virtual object needs to have at least a logical 
location in a virtual space associated with an actual space, includes a virtual object at a point, 
which does not have a predetermined range, and also includes a virtual object which has a 
predetermined range but does not have a clear boundary. To configure an example virtual 
object having a predetermined area but not having a clear boundary, the RFID can be used. 
In this case, a non-contact-type tag from which the tag ID can be read in a non-contact 
manner is attached to the mobile member, and a tag-ID reading device for reading the tag ID 
of a non-contact-type tag from the tag in a non-contact manner is provided. In other words, a 
space in which the tag-ID reading device can read a tag ID constitutes a virtual object. The 
same points are applied to service providing systems, to service providing programs, and to 
service providing methods which has above structure. 

[0050] The predetermined condition is not limited to a condition that the location of 
the mobile member matches that of the virtual object. It includes, for example, a condition 
that the distance between the mobile member and the virtual object is a predetermined length 
or shorter, or a condition that a direction in which the virtual object sees the mobile member 
is a predetermined direction. The same points are applied to service providing programs, and 
to service providing methods. 

[0051] Further, a service providing system according to the present invention can be 
a service providing system for associating service with a virtual object, for disposing the 
virtual object in a virtual space associated with an actual space, and for providing service 
corresponding to the virtual object according to a positional relationship between a movable 
mobile member and the virtual object. The present invention can include a storage device for 
associating object information related to the virtual object with service information 
specifying the content of service, and for storing them. When it is determined according to 
the object information stored in the storage device that the positional relationship between the 
mobile member and the virtual object satisfies a predetermined condition, the service 
corresponding to the virtual object is provided according to the service information stored in 
the storage device. The invention can further include an input device for performing an input 
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related to generation, deletion, or update of the object information and object-information 
processing device for generating, deleting, or updating the object information according to 
the content of the input performed by the input device. 

[0052] With such a structure, when it is determined according to the object 
information stored in the storage device that the positional relationship between the mobile 
member and the virtual object satisfies a predetermined condition, service corresponding to 
the virtual object is provided according to the service information stored in the storage 
device. When the user, the system administrator, or another person performs an input related 
to generation, deletion, or update of the object information through the input device, the 
object-information processing device generates, deletes, or updates the object information 
according to the content of the input. 

[0053] To achieve the foregoing object, a management terminal according to the 
present invention is a terminal connected to the mobile member used in a service providing 
system in a communication-allowed manner. The present invention can include a storage 
device, wherein, when the terminal receives the location information, it determines according 
to the received location information and the object information stored in the storage device 
whether the mobile member is disposed in the inside area of the virtual object identified by 
the shape and location of the virtual object. With such a structure, a function having the same 
level as the function of the management terminal in the service providing system is obtained. 

[0054] To achieve the foregoing object, a mobile member according to the present 
invention can be a mobile member connected to the management terminal used in a service 
providing system in a communication-allowed manner, including a location-information 
acquisition device. When the mobile member receives the object information, the member 
can determine according to the location information obtained by the location-information 
acquisition device and the received object information whether the mobile member is 
disposed in the inside area of the virtual object identified by the shape and location of the 
virtual object. With such a structure, a function having the same level as the function of the 
mobile member in the service providing system is obtained. 

[0055] To achieve the foregoing object, a service providing program according to 
the present invention is a service providing program for associating service with a virtual 
object, for disposing the virtual object in a virtual space associated with an actual space, and 
for providing service corresponding to the virtual object according to a positional relationship 
between a movable mobile member and the virtual object, the program making a computer 
which is capable of using a storage device for associating object information related to the 
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shape and location of the virtual object with service information specifying a service content 
and for storing them, and a location-information acquisition device for obtaining location 
information used for identifying the location of the mobile member, execute processing in 
which, when it is determined according to the location information obtained by the location- 
information acquisition device and the object information stored in the storage device that the 
mobile member is disposed in the inside area of the virtual object identified by the shape and 
location of the virtual object, service corresponding to the virtual object is provided according 
to the service information stored in the storage device. 

[0056] With such a structure, when the computer reads the program and executes 
the processing according to the read program, the same function as that of the service 
providing system can be obtained. 

[0057] A service providing program according to the present invention is a service 
providing program for associating service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, and for providing service 
corresponding to the virtual object according to a positional relationship between a movable 
mobile member and the virtual object. The program can make a computer which is capable 
of using storage device for associating object information related to the virtual object with 
operation information specifying the content of an operation of the mobile member or another 
apparatus, and for storing them, execute processing in which, when it is determined according 
to the object information stored in the storage device that the positional relationship between 
the mobile member and the virtual object satisfies a predetermined condition, the mobile 
member or the another apparatus is operated according to the operation information 
corresponding to the virtual object, stored in the storage device. 

[0058] With such a structure, when the computer reads the program and executes 
the processing according to the read program, the same function as that of the service 
providing system can be obtained. 

[0059] A service providing program according to the present invention is a service 
providing program for associating service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, and for providing service 
corresponding to the virtual object according to a positional relationship between a movable 
mobile member and the virtual object. The program can make a computer which is capable 
of using storage device for associating object information related to the virtual object with 
service information specifying the content of service, and for storing them, execute 
processing in which, when it is determined according to the object information stored in the 
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storage device that the positional relationship between the mobile member and the virtual 
object satisfies a predetermined condition, the service corresponding to the virtual object is 
provided according to the service information stored in the storage device, and processing 
implemented as an input device for performing an input related to generation, deletion, or 
update of the object information, and object-information processing device for generating, 
deleting, or updating the object information according to the content of the input performed 
by the input device. 

[0060] With such a structure, when the computer reads the program and executes 
the processing according to the read program, the same function as that of the service 
providing system is obtained. 

[0061) A service providing method according to the present invention is a service 
providing method for associating service with a virtual object, for disposing the virtual object 
in a virtual space associated with an actual space. The invention also provides service 
corresponding to the virtual object according to a positional relationship between a movable 
mobile member and the virtual object. The invention can include the steps of associating 
object information related to the shape and location of the virtual object with service 
information specifying a service content and storing them, and obtaining location information 
used for identifying the location of the mobile member. When it is determined, according to 
the obtained location information and the stored object information that the mobile member is 
disposed in the inside area of the virtual object identified by the shape and location of the 
virtual object, providing service corresponding to the virtual object according to the stored 
service information. 

[0062] With such a structure, the same function as that of the service providing 
system is obtained. 

[0063] A service providing method according to the present invention is a service 
providing method for associating service with a virtual object, for disposing the virtual object 
in a virtual space associated with an actual space, and for providing service corresponding to 
the virtual object according to a positional relationship between a movable mobile member 
and the virtual object. The method can include the steps of associating object information 
related to the virtual object with operation information specifying the content of an operation 
of the mobile member or another apparatus, and storing them, and when it is determined 
according to the stored object information that the positional relationship between the mobile 
member and the virtual object satisfies a predetermined condition, the mobile member or the 
another apparatus is operated according to the stored operation information corresponding to 
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the virtual object. With such a structure, the same function as that of the service providing 
system is obtained. 

[0064] A service providing method according to the present invention is a service 
providing method for associating service with a virtual object, for disposing the virtual object 
in a virtual space associated with an actual space, and for providing service corresponding to 
the virtual object according to a positional relationship between a movable mobile member 
and the virtual object. The method can include the steps of associating object information 
related to the virtual object with service information specifying the content of service, and 
storing them, and when it is determined according to the stored object information that the 
positional relationship between the mobile member and the virtual object satisfies a 
predetermined condition, providing the service corresponding to the virtual object according 
to the stored service information. The method can further include the steps of performing an 
input related to generation, deletion, or update of the object information, and generating, 
deleting, or updating the object information according to the content of the performed input. 
With such a structure, the same function as that of the service providing system is obtained. 

[0065] In the foregoing description, a service providing system, a management 
terminal, a mobile member, a service providing program, and a service providing method 
which achieve the foregoing object are provided. In addition to these things, first and second 
storage media, described below, can be provided to achieve the foregoing object. 

[0066] The first storage medium is a computer-readable storage medium storing a 
program to be applied to the management terminal according to the present invention. When 
the location information is received, the program makes a computer having or being capable 
of using the storage device execute processing for determining according to the received 
location information and the object information stored in the storage device whether the 
mobile member is disposed in the inside area of the virtual object identified by the shape and 
location of the virtual object. With such a structure, when the program stored in the storage 
medium is read by a computer and the computer executes the read program, a function having 
the same level and an advantage having the same level as the function and advantage 
obtained by the management terminal according to the present invention are obtained. 

[0067] The second storage medium is a computer-readable storage medium storing 
a program to be applied to the mobile member according to the present invention. When the 
object information is received, the program makes a computer having or being capable of 
using the location-information acquisition device execute processing for determining 
according to the location information obtained by the location-information acquisition device 
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and the received object information whether the mobile member is disposed in the inside area 
of the virtual object identified by the shape and location of the virtual object. With such a 
structure, when the program stored in the storage medium is read by a computer and the 
computer executes the read program, a function having the same level and an advantage 
having the same level as the function and advantage obtained by the mobile member 
according to the present invention are obtained. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0068] The invention will be described with reference to the accompanying 
drawings, wherein like numerals reference like elements, and wherein: 

Fig. 1 is a view showing the structure of a network system to which the present 
invention is applied; 

Fig. 2 is a view showing the structure of the network system to which the present 
invention is applied; 

Fig. 3 is an exemplary block diagram showing the structure of a virtual-object 
management apparatus 100; 

Fig. 4 is a view showing an exemplary data structure in a virtual-object management 
table 400; 

Fig. 5 is a flowchart of virtual-object generating processing; 
Fig. 6 is a flowchart of virtual-object deleting processing; 
Fig. 7 is a flowchart of virtual-object updating processing; 
Fig. 8 is a flowchart of object-information transmitting processing; 
Fig. 9 is an exemplary block diagram showing the structure of a virtual -object-setting 
apparatus 200; 

Fig. 10 is a flowchart of virtual-object-generation request processing; 

Fig. 1 1 is a flowchart of virtual-object-deletion request processing; 

Fig. 12 is a flowchart of virtual-object- update request processing; 

Fig. 13 is an exemplary block diagram showing the structure of a digital camera 300; 

and 

Fig. 14 is a flowchart of object-information- transmission request processing. 
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

[0069] An exemplary embodiment of the present invention will be described below 
by referring to the drawings. Fig. 1 to Fig. 14 are views showing a service providing system, 
a management terminal, a mobile member, a service providing program, and a service 
providing method according to an embodiment of the present invention. 
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[0070] In the present embodiment, a service-providing system, a management 
terminal, a mobile member, a service providing program, and a service providing method 
according to the present invention are applied to a case in which in an art museum, as shown 
in Fig. 1 and Fig. 2, a virtual-object-setting apparatus 200 disposes and specifies cubic virtual 
objects A and B before pictures A and B exhibited on a wall surface, and capturing with a 
digital camera 300 is prohibited in the inside areas of the virtual objects A and B. 

[0071] The structure of a network system to which the present invention is applied 
will be described first by referring to Fig. 1 and Fig. 2. Fig. 1 and Fig. 2 are views showing 
the structure of the network system to which the present invention is applied. 

[0072] A virtual-object management apparatus 100 for managing virtual objects is 
placed, for example, as shown in Fig. 1 , at an end of a wall surface in an art museum, and can 
bi-directionally communicate with the virtual -object-setting apparatus 200 for disposing and 
setting virtual objects, by radio communication. The virtual-object-setting apparatus 200 is 
formed of a personal digital assistant (PDA), and is used by a staff member of the art museum 
in the present embodiment. 

[0073] The virtual-object management apparatus 100 can bi-directionally 
communicate by radio communication with the digital camera digital camera 300, which can 
capture images as digital data, as shown in Fig. 2. The digital camera 300 can be 
automatically set by internal processing such that capturing is enabled or disabled, and is 
used by a visitor to the art museum in the present embodiment. 

[0074] The structure of the virtual -object management apparatus 100 will be 
described next in detail by referring to Fig. 3. Fig. 3 is an exemplary block diagram showing 
the structure of the virtual-object management apparatus 1 00. 

[0075] The virtual-object management apparatus 100 includes, as shown in Fig. 3, a 
CPU 30 for controlling calculations and the entire system according to a control program, a 
ROM 32 for storing the control program used by the CPU 30 in a predetermined area in 
advance, a RAM 34 for storing data read from the ROM 32 and calculation results necessary 
in a calculation process of the CPU 30, and an interface (I/F) 38 for sending and receiving 
data to and from external apparatuses. These components are connected to each other in a 
data transferable manner through a bus 39 which is a signal line for transferring data. 

[0076] The interface (I/F) 38 can be connected to external apparatuses, such as a 
radio communication apparatus 40 for communicating with the virtual-object-setting 
apparatus 200 and the digital camera 300 by radio communication, a virtual-object 
management data base (hereinafter, a data base is abbreviated as a DB) 42 for registering and 
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managing object information related to virtual objects, and a display apparatus 44 for 
displaying a screen according to an image signal. 

[0077] The virtual-object management DB 42 can store a virtual-object 
management table 400 in which object information related to the shapes and locations of 
virtual objects can be registered correspondingly to service information which specifies 
service contents, as shown in Fig. 4. 

[0078] Fig. 4 is a view showing an exemplary data structure of the virtual -object 
management table 400. In the virtual-object management table 400, as shown in Fig. 4, one 
record can be registered for each virtual object. Each record can include a field 402 for 
registering a serial number, a field 404 for registering coordinates indicating the location of 
the virtual object in a virtual space corresponding to an actual space, a field 406 for 
registering the shape of the virtual object, a field 408 for registering the size of the virtual 
object, a field 410 for registering an action to be associated with the virtual object, and a field 
412 for registering supplementary information for the virtual object. The data in the fields 
404, 406, and 408 corresponds to object information, and the data in the fields 410 and 412 
correspond to service information. 

[0079] In the example shown in Fig. 4, at a first-row record, a serial number of "1" 
is input in the field 402, coordinates of "(10, 50, 20)" in the field 404, a size of "cube" is in 
the field 406, a size of "5 m" in the field 408, an action of "capturing prohibition" in the field 
410, and a supplementary information of "Null" in the field 412. This record device that a 
cubic virtual object having a side length of 5 m is virtually disposed with coordinates (10, 50, 
20) being assigned to its center, and capturing with the digital camera 300 is prohibited in the 
inside area of the virtual object identified by its location and shape. 

[0080] A supplementary information of "Null" indicates that there is no supplementary 
information. 

[0081] The CPU 30 is forrned of a microprocessing unit MPU, activates a 
predetermined program stored at a predetermined area in the ROM 32, and executes in a 
time-division manner virtual-object generating processing, virtual-object deleting processing, 
virtual -object updating processing and object-information transmitting processing shown in 
flowcharts of Fig. 5 to Fig. 8, according to the program. 

[0082] The virtual-object generating processing will be described first in detail by 
referring to Fig. 5. Fig. 5 is a flowchart showing an exemplary virtual-object generating 
processing. 
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[0083] The virtual -object generating processing disposes and sets a virtual object 
according to a generation request sent from the virtual-object-setting apparatus 200. When 
the CPU 30 starts executing the processing, the processing proceeds to step SI 12 as shown in 
Fig. 5. 

[0084] In step SI 12, it is determined whether a request for generating a virtual 
object has been received. When it is determined that a generation request has been received 
(Yes), the processing proceeds to step SI 14, and otherwise (No), the processing continues to 
monitor in step SI 1 2 until a generation request is received. 

[0085] In step SI 14, object information and service information are received. The 
processing proceeds to step SI 16, and the received object information is associated with the 
service information, and they are registered into the virtual-object management table 400. 
The processing proceeds to step SI 18, and a notice of completion of the generation of the 
virtual object is sent to the virtual -object-setting apparatus 200, a series of processes are 
terminated, and the processing returns to the original processing. 

[0086] The virtual-object deleting processing will be described next in detail by 
referring to Fig. 6. Fig. 6 is a flowchart showing an exemplary virtual-object deleting 
processing. 

[0087] The virtual -object deleting processing deletes a virtual object according to a 
deletion request sent from the virtual-object-setting apparatus 200. When the CPU 30 starts 
executing the processing, the processing proceeds to step S206, as shown in Fig. 6. 

[0088] In step S206, it is determined whether a request for deleting a virtual object 
has been received. When it is determined that a deletion request has been received (Yes), the 
processing proceeds to step S208, and otherwise (No), the processing awaits in step S206 
until a deletion request is received. 

[0089] In step S208, location information is received. The processing proceeds to 
step S210, and the virtual-object management table 400 is searched according to the received 
location information for the corresponding object information. More specifically, in step 
S210, the object information of a virtual object(s) disposed within a predetermined distance 
(such as 10 m) from the location of the virtual-object-setting apparatus 200, specified by the 
location information is searched for. The virtual object(s) corresponding to the found object 
information is to be deleted. 

[0090] In other words, the virtual-object-setting apparatus 200 needs to move into 
the inside area of the virtual object(s) to be deleted or close to the area in order to delete the 
virtual object. 
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[0091] Then, the processing proceeds to step S21 1. and a list of virtual objects to be 
deleted is generated according to the found object information. The processing proceeds to 
step S212, and the generated list of virtual objects is sent to the virtual-object-setting 
apparatus 200. The processing proceeds to step S222. 

[0092] In step S222, it is determined whether a request for deleting virtual objects 
according to the list of virtual objects has been received. When it is determined that a 
deletion request has been received (Yes), the processing proceeds to step S224, the object 
information and the service information of the virtual objects to be deleted are deleted. The 
processing proceeds to step S222. 

[0093] When it is determined in step S222 that a deletion request has not yet been 
received (No), the processing proceeds to step S230, and it is determined whether a 
termination request for terminating the deletion of virtual objects has been received. When it 
is determined that a termination request has been received (Yes), the processing proceeds to 
step S232, a notice of completion of the deletion of the virtual objects is sent to the virtual- 
object-setting apparatus 200, a series of processes is finished, and the processing returns to 
the original processing. 

[0094] When it is determined in step S230 that a termination request has not yet 
been received (No), the processing proceeds to step S222. 

[0095] The virtual-object updating processing will be described next in detail by 
referring to Fig. 7. Fig. 7 is a flowchart showing an exemplary virtual -object updating 
processing. 

[0096] The virtual-object updating processing updates a virtual object according to 
an update request sent from the virtual-object-setting apparatus 200. When the CPU 30 starts 
executing the processing, the processing proceeds to step S3 06, as shown in Fig. 7. 

[0097] In step S306, it is determined whether a request for updating a virtual object 
has been received. When it is determined that an update request has been received (Yes), the 
processing proceeds to step S308, and otherwise (No), the processing awaits at step S306 
until an update request is received. 

[0098] In step S308, location information is received. The processing proceeds to 
step S3 10, and the virtual-object management table 400 is searched according to the received 
location information for the corresponding object information. More specifically, in step 
S3 10, the object information of a virtual object(s) disposed within a predetermined distance 
from the location of the virtual -object-setting apparatus 200, specified by the location 
information is searched for. The virtual object(s) corresponding to the found object 
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information is to be updated. In other words, the virtual-object-setting apparatus 200 needs to 
move into the inside area of the virtual object(s) to be updated or close to the area in order to 
update the virtual object. 

[0099] Then, the processing proceeds to step S3 1 1 , and a list of virtual objects to be 
updated is generated according to the found object information. The processing proceeds to 
step S3 12, and the generated list of virtual objects is sent to the virtual-object-setting 
apparatus 200. The processing proceeds to step S328. 

[0100] In step S328, it is determined whether a request for updating virtual objects 
according to the list of virtual objects has been received. When it is determined that an 
update request has been received (Yes), the processing proceeds to step S330, and object 
information and service information are received. The processing proceeds to step S332, and 
the object information and the service information of virtual objects to be updated are 
updated according to the received object information and the received service information. 
The processing proceeds to step S328. 

[0101] When it is determined in step S328 that an update request has not yet been 
received (No), the processing proceeds to step S338, and it is determined whether a 
termination request for terminating the update of virtual objects has been received. When it 
is determined that a termination request has been received (Yes), the processing proceeds to 
step S340, a notice of completion of the update of the virtual objects is sent to the virtual- 
object-setting apparatus 200, a series of processes is finished, and the processing returns to 
the original processing. 

[0102] When it is determined in step S338 that a termination request has not yet 
been received (No), the processing proceeds to step S328. 

[0103] The object-information transmitting processing will be described next in 
detail by referring to Fig. 8. Fig. 8 is a flowchart showing an exemplary object-information 
transmitting processing. 

[0104] The object-information transmitting processing transmits object information 
stored in the virtual-object management DB 42 according to a transmission request sent from 
the digital camera 300. When the CPU 30 starts executing the processing, the processing 
proceeds to step S404, as shown in Fig. 8. 

[0105] In step S404, it is determined whether a request for transmitting object 
information has been received. When it is determined that a transmission request has been 
received (Yes), the processing proceeds to step S406, and otherwise (No), the processing 
awaits at step S404 until a transmission request is received. 
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[0106] In step S406, location information is received. The processing proceeds to 
step S408, and the virtual-object management table 400 is searched according to the received 
location information for the corresponding object information. More specifically, in step 
S408, the object information of a virtual object(s) disposed within a predetermined distance 
from the location of the virtual-object-setting apparatus 200, specified by the location 
information is searched for. The found object information is to be transmitted. 

[0107] Then, the processing proceeds to step S410, the found object information 
and the service information corresponding thereto are transmitted to the digital camera 300, a 
series of processes is finished, and the processing returns to the original processing. 

[0108] The structure of the virtual -object-setting apparatus 200 will be described in 
detail by referring to Fig. 9. Fig. 9 is an exemplary block diagram showing the structure of 
the virtual-object-setting apparatus 200. 

[0109] The virtual-object-setting apparatus 200 can include, as shown in Fig. 9, a 
CPU 50 for controlling calculations and the entire system according to a control program, a 
ROM 52 for storing the control program used by the CPU 50 in a predetermined area in 
advance, a RAM 54 for storing data read from the ROM 52 and calculation results necessary 
in a calculation process of the CPU 50, and an interface (I/F) 58 for sending and receiving 
data to and from external apparatuses. These components are preferably connected to each 
other in a data transferable manner through a bus 59 which is a signal line for transferring 
data. 

[0110] The interface (I/F) 58 is connected to external apparatuses, such as a radio 
communication apparatus 60 for communicating with the virtual-object management 
apparatus 1 00 by radio communication, a key panel 62 serving as a human interface for 
allowing data to be input by a plurality of keys, a liquid-crystal display (LCD) 64 for 
displaying a screen according to an image signal, and a location-information acquisition 
apparatus 66 for measuring the current location of the virtual-object-setting apparatus 200 to 
obtain location information identifying the location. 

[0111] The location-information acquisition apparatus 66 receives from non- 
geostationary satellites for sending time signals indicating the current time the time signals, 
measures the location of the current point by using a so-called GPS for measuring a location 
according to the differences between the times indicated by the time signals and the orbits of 
the non-geostationary satellites, and outputs the measured location of the current point as 
location information. 
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[0112) The CPU 50 is formed of a microprocessing unit MPU, activates a 
predetermined program stored at a predetermined area in the ROM 52, and executes in a 
time-division manner virtual-object-generation request processing, virtual-object-deletion 
request processing, and virtual-object-update request processing shown in flowcharts of Fig. 
10 to Fig. 12, according to the program. 

[0113] The virtual-object-generation request processing will be described first in 
detail by referring to Fig. 10. Fig. 10 is a flowchart showing an exemplary virtual-object- 
generation request processing. 

[0114] The virtual-object-generation request processing corresponds to the virtual- 
object generating processing shown in Fig. 5, requests the virtual-object management 
apparatus 100 to generate a virtual object. When the CPU 50 starts executing the processing, 
the processing proceeds to step SI 00 as shown in Fig. 10. 

[0115] In step S100, it is determined whether the user of the virtual-object-setting 
apparatus 200 has instructed the generation of a virtual object. When it is determined that the 
generation of a virtual object has been instructed (Yes), the processing proceeds to step SI 02, 
and otherwise (No), the processing awaits in step SI 00 until the generation of a virtual object 
is instructed. 

[0116] In step SI 02, location information is obtained from the location-information 
acquisition apparatus 66. The processing proceeds to step SI 04, and an action to be 
associated with the virtual object is selected from among a plurality of actions through the 
key panel 62. Actions which can be selected include an action for prohibiting capturing and 
an action for indicating a description. 

[0117] Then, the processing proceeds to step SI 06, and the shape and size of the 
virtual object are input from the key panel 62. The processing proceeds to step SI 08, and 
object information and service information are generated according to the obtained location 
information and the selection result and the input result of steps SI 04 and SI 06. The 
processing proceeds to step SI 10, and a request for generating the virtual object is sent 
together with the generated object information and the generated service information to the 
virtual -object management apparatus 100. The processing proceeds to step SI 20. 

[0118] In step SI 20, it is determined whether a notice of completion of the 
generation of the virtual object has been received. When it is determined that a generation- 
completion notice has been received (Yes), the processing proceeds to step SI 22, a message 
indicating that the generation of the virtual object has been completed is shown in the LCD 
64, a series of processes are terminated, and the processing returns to the original processing. 



[0119] On the other hand, when it is determined in step SI 20 that a generation 
completion notice has not yet been received (No), the processing awaits in step SI 20 until a 
generation completion notice is received. 

[0120] The virtual-object-deletion request processing will be described next in 
detail by referring to Fig. 1 1 . Fig. 1 1 is a flowchart showing an exemplary virtual -object- 
deletion request processing. 

[0121] The virtual-object-deletion request processing corresponds to the virtual- 
object deleting processing shown in Fig. 6, requests the virtual-object management apparatus 
100 to delete a virtual object. When the CPU 50 starts executing the processing, the 
processing proceeds to step S200 as shown in Fig. 1 1 . 

[0122] In step S200, it is determined whether the user has instructed the deletion of 
a virtual object. When it is determined that the deletion of a virtual object has been instructed 
(Yes), the processing proceeds to step S202, and otherwise (No), the processing awaits in 
step S200 until the deletion of a virtual object is instructed. 

[0123] In step S202, location information is obtained from the location-information 
acquisition apparatus 66. The processing proceeds to step S204, and a request for deleting 
the virtual object is sent together with the obtained location information to the virtual-object 
management apparatus 100. The processing proceeds to step S214. 

[0124] In step S214, it is determined whether a list of virtual objects has been 
received. When it is determined that a list of virtual objects has been received (Yes), the 
processing proceeds to step S216, and the received list of virtual objects is displayed on the 
LCD 64. The processing proceeds to step S21 8. 

[0125] In step S2 1 8, it is determined whether a virtual object to be deleted has been 
selected from the list of virtual objects. When it is determined that a virtual object to be 
deleted has been selected from the list (Yes), the processing proceeds to step S220, and a 
request for deleting the virtual object according to the list of virtual objects is sent to the 
virtual-object management apparatus 100. The processing proceeds to step S218. 

[0126] On the other hand, in step S21 8, when it is determined that a virtual object 
has not yet been selected (No), the processing proceeds to step S226, and it is determined 
whether the user has instructed a deletion termination of a virtual object. When it is 
determined that a deletion termination of a virtual object has been instructed (Yes), the 
processing proceeds to step S228, and a termination request for terminating the deletion of a 
virtual object is sent to the virtual-object management apparatus 100. The processing 
proceeds to step S234. 
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[0127] In step S234, it is determined whether a notice of completion of the deletion 
of the virtual object has been received. When it is determined that a deletion-completion 
notice has been received (Yes), the processing proceeds to step S236, a message indicating 
that the deletion of the virtual object has been completed is shown in the LCD 64, a series of 
processes are terminated, and the processing returns to the original processing. 

[0128] On the other hand, when it is determined in step S234 that a deletion- 
completion notice has not yet been received (No), the processing awaits in step S234 until a 
deletion-completion notice is received. 

[0129] On the other hand, in step S226, when it is determined that a deletion 
termination of a virtual object has not yet been instructed (No), the processing proceeds to 
step S218. 

[0130] On the other hand, when it is determined in step S214 that the list of virtual 
objects has not yet been received (Yes), the processing awaits in step S214 until the list of 
virtual objects is received. 

[0131] The virtual-object-update request processing will be described next in detail 
by referring to Fig. 12. Fig. 12 is a flowchart showing an exemplary virtual-object-update 
request processing. 

[0132] The virtual -object-update request processing corresponds to the virtual- 
object updating processing shown in Fig. 7, requests the virtual-object management apparatus 
100 to update a virtual object. When the CPU 50 starts executing the processing, the 
processing proceeds to step S300 as shown in Fig. 12. 

[0133] In step S300, it is determined whether the user has instructed the update of a 
virtual object. When it is determined that the update of a virtual object has been instructed 
(Yes), the processing proceeds to step S302, and otherwise (No), the processing awaits in 
step S300 until the update of a virtual object is instructed. 

[0134] In step S302, location information is obtained from the location-information 
acquisition apparatus 66. The processing proceeds to step S304, and a request for updating 
the virtual object is sent together with the obtained location information to the virtual-object 
management apparatus 100. The processing proceeds to step S3 14. 

[0135] In step S3 14, it is determined whether a list of virtual objects has been 
received. When it is determined that a list of virtual objects has been received (Yes), the 
processing proceeds to step S3 16, and the received list of virtual objects is displayed on the 
LCD 64. The processing proceeds to step S3 18. 
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[0136] In step S3 18, it is determined whether a virtual object to be updated has been 
selected from the list of virtual objects. When it is determined that a virtual object to be 
updated has been selected from the list (Yes), the processing proceeds to step S320, and an 
action to be associated with the virtual object is selected from a plurality of actions. The 
processing proceeds to step S322, and the shape and size of the virtual object are input from 
the key panel 62. The processing proceeds to step S324, and object information and service 
information are generated according to the obtained location information and the selection 
result and the input result of step S320 and step S322. The processing proceeds to step S326, 
the generated object information and the generated service information are sent together with 
a request for updating the virtual object according to the list of virtual objects to the virtual- 
object management apparatus 100. The processing proceeds to step S3 18. 

[0137] On the other hand, in step S3 18, when it is determined that a virtual object 
has not yet been selected (No), the processing proceeds to step S334, and it is determined 
whether the user has instructed an update termination of a virtual object. When it is 
determined that an update termination of a virtual object has been instructed (Yes), the 
processing proceeds to step S336, and a termination request for terminating the update of a 
virtual object is sent to the virtual-object management apparatus 100. The processing 
proceeds to step S342. 

[0138] In step S342, it is determined whether a notice of completion of the update 
of the virtual object has been received. When it is determined that an update-completion 
notice has been received (Yes), the processing proceeds to step S344, a message indicating 
that the update of the virtual object has been completed is shown in the LCD 64, a series of 
processes are terminated, and the processing returns to the original processing. 

[0139] On the other hand, when it is determined in step S342 that an update- 
completion notice has not yet been received (No), the processing awaits in step S342 until an 
update-completion notice is received. 

[0140] On the other hand, in step S334, when it is determined that an update 
termination of a virtual object has not yet been instructed (No), the processing proceeds to 
step S3 18. 

[0141] On the other hand, when it is determined in step S3 14 that the list of virtual 
objects has not yet been received (Yes), the processing awaits in step S3 14 until the list of 
virtual objects is received. 
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[0142] The structure of the digital camera 300 will be described next in detail by 
referring to Fig. 13. Fig. 13 is an exemplary block diagram showing the structure of the 
digital camera 300. 

[0143] The digital camera 300 includes, as shown in Fig. 13, a CPU 70 for 
controlling calculations and the entire system according to a control program, a ROM 72 for 
storing the control program used by the CPU 70 in a predetermined area in advance, a RAM 
74 for storing data read from the ROM 72 and calculation results necessary in a calculation 
process of the CPU 70, and an interface (I/F) 78 for sending and receiving data to and from 
external apparatuses. These components are connected to each other in a data transferable 
manner through a bus 79 which is a signal line for transferring data. 

[0144] The interface (I/F) 78 is connected to external apparatuses, such as a radio 
communication apparatus 80 for communicating with the virtual-object management 
apparatus 1 00 by radio communication, a key panel 82 serving as a human interface for 
allowing data to be input by a plurality of keys, a liquid-crystal display (LCD) 84 for 
displaying a screen according to an image signal, a location-information acquisition apparatus 
86 for measuring the current location of the digital camera 300 to obtain location information 
identifying the location, and a capturing apparatus 88 for capturing images as digital data. 

[0145] The CPU 70 is formed of a microprocessing unit MPU, activates a 
predetermined program stored at a predetermined area in the ROM 72, and executes object- 
information-transmission request processing shown in a flowchart of Fig. 14, according to the 
program. Fig. 14 is a flowchart showing the object-information-transmission request 
processing. 

[0146] The object-information-transmission request processing corresponds to the 
object-information transmitting processing shown in Fig. 8, and requests the virtual-object 
management apparatus 100 to send object information and service information. When the 
CPU 70 starts executing the processing, the processing proceeds to step S400 as shown in 
Fig. 14. 

[0147] In step S400, location information is obtained from the location-information 
acquisition apparatus 86. The processing proceeds to step S402, and the obtained location 
information is sent together with a request for transmitting object information to the virtual- 
object management apparatus 100. The processing proceeds to step S412. 

[0148] In step S412, it is determined whether object information and service 
information have been received. When it is determined that object information and service 
information have been received (Yes), the processing proceeds to step S4 1 4, and 
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interpretation processing for interpreting the received object information and the received 
service information is executed. The request processing proceeds to step S416. 

[0149] In step S416, it is determined according to the interpretation result of step 
S4 14 whether the digital camera 300 is disposed in the inside area of the virtual object. 
When it is determined that the digital camera 300 is disposed in the inside area of the virtual 
object (Yes), the processing proceeds to step S418, and it is determined whether an action 
associated with the virtual object is capturing prohibition. When it is determined that the 
action is capturing prohibition (Yes), the processing proceeds to step S420, and capturing 
with the capturing apparatus 88 is made prohibited. The processing proceeds to step S422. 

[0150] In step S422, it is determined whether the action associated with the virtual 
object is the indication of a description. When it is determined that the action is the 
indication of a description (Yes), the processing proceeds to step S424, supplementary 
information included in the service information is displayed on the LCD 84, a series of 
processes is terminated, and the processing proceeds to the original processing. 

[0151] On the other hand, in step S422, when it is determined that the action 
associated with the virtual object is not the indication of a description (No), the series of 
processes is terminated, and the processing proceeds to the original processing. 

[0152] On the other hand, in step S41 8, when it is determined that the action 
associated with the virtual object is not capturing prohibition (No), the processing proceeds to 
step S422. 

[0153] On the other hand, in step S416, it is determined that the digital camera 300 
is not disposed in the inside area of the virtual object (No), the processing proceeds to step 
S426, and it is determined whether capturing has been prohibited. When it is determined that 
capturing has been prohibited (Yes), the processing proceeds to step S428, the prohibition of 
capturing is released, the series of processes is terminated, and the processing proceeds to the 
original processing. 

[0154] On the other hand, in step S426, when it is determined that the prohibition of 
capturing has not been set (No), the series of processes is terminated, and the processing 
proceeds to the original processing. 

[0155] On the other hand, in step S412, when it is determined that object 
information and service information have not been received (No), the processing awaits in 
step S412 until object information and service information are received. 

[0156] Operations in the above-described embodiment will be described next. 

[0157] A case in which a virtual object is generated will be described first. 
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[0158] A staff member of the art museum uses the virtual-object-setting apparatus 
200 to generate a virtual object. The staff member first instructs the virtual-object-setting 
apparatus 200 to generate a virtual object. 

[0159] When the user instructs the generation of a virtual object, the virtual-object- 
setting apparatus 200 obtains location information from the location-information acquisition 
apparatus 66 and requests the user to select an action to be associated with the virtual object 
through step SI 02 and step SI 04. In response to the selection request, the user selects an 
action to be associated with the virtual object from a plurality of actions. In this case, since 
the staff member of the art museum wants to prohibit capturing of the pictures A and B, the 
staff member selects the prohibition of capturing as an action to be associated with the virtual 
object. 

[0160] When the action is selected, the virtual-object-setting apparatus 200 requests 
the user to input the shape and size of the virtual object through step SI 06. In response to the 
input request, the user inputs the shape and size of the virtual object. In this case, since the 
staff member of the art museum wants to prohibit capturing of the pictures A and B, the staff 
member inputs a cubic shape which includes a viewing area and an appropriate size. In the 
example shown in Fig. 1, cubic virtual objects A and B are specified in front of the pictures A 
and B, respectively. 

[0161] When the shape and size of the virtual object are input, the virtual-object- 
setting apparatus 200 generates object information and service information according to the 
obtained location information and the selection result and the input result of step SI 04 and 
step SI 06, and sends a generation request together with the generated object information and 
the generated service information to the virtual-object management apparatus 100 through 
step SI 08 and step SI 10. 

[0162] When the virtual-object management apparatus 100 receives the generation 
request, the apparatus receives the object information and the service information, associates 
the object information with the service information and stores them in the virtual-object 
management table 400, and sends a notice of completion of the generation of the virtual 
object to the virtual-object-setting apparatus 200 through step SI 14 to step SI 18. 

[0163] When the virtual-object-setting apparatus 200 receives the generation- 
completion notice, it displays a message indicating that the generation of the virtual object 
has been completed through step SI 22. 

[0164] A case in which an attempt is made by a viewer having the digital camera 
300 to capture the pictures A and B near them will be described next. 
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[0165] When the viewer having the digital camera 300 comes close to the pictures 
A and B in a condition in which the virtual objects A and B have been specified as described 
above, the digital camera 300 obtains location information from the location-information 
acquisition apparatus 86, and sends a transmission request together with the obtained location 
information to the virtual-object management apparatus virtual-object management apparatus 
100 through steps S400 and S402. 

[0166] When the virtual-object management apparatus 100 receives the 
transmission request, the apparatus receives the location information, and searches the 
virtual-object management table 400 according to the received location information for the 
corresponding object information through step S406 and step S408. In this case, the object 
information of the virtual objects A and B are found. 

[0167] The virtual-object management apparatus 100 sends the found object 
information and the service information corresponding thereto to the digital camera 300 
through step S410. 

[0168] When the digital camera 300 receives the object information and the service 
information, the camera interprets the received object information and the received service 
information, and determines according to the interpretation result that the digital camera 300 
is disposed in the inside area of the virtual object, through step S414 and step S416. In this 
case, since the viewer is located close to the pictures A and B, the digital camera 300 is 
disposed in the inside area of a virtual object. Therefore, through steps S418 and S420, the 
prohibition of capturing by the use of the capturing apparatus 88 is specified. 

[0169] Consequently, in this state, the viewer cannot capture the pictures A and B 
by the use of the digital camera 300. 

[0170] When the viewer moves away from the inside areas of the virtual objects A 
and B, the digital camera 300 receives object information and service information. Since it is 
determined that the digital camera 300 is not disposed in the inside areas of the virtual 
objects, the prohibition of capturing is released through steps S416, S426, and S428. 

[0171] In the above example, an action of the prohibition of capturing has been 
associated with the virtual objects. When an action of the indication of a description is 
associated, for example, the digital camera 300 performs the same processes up to step S416, 
and then, indicates descriptions of the pictures A and B through steps S422 and S424. 

[0172] A case in which a virtual object is deleted will be described next. 

[0173] A staff member of the art museum uses the virtual-object-setting apparatus 
200 to delete a virtual object. The staff member first moves to a place where the virtual 
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objects A and B have been specified, and instructs the virtual -object-setting apparatus 200 to 
delete the virtual objects. 

[0174] When the virtual-object-setting apparatus 200 receives a user instruction of 
the deletion of the virtual objects, it receives location information from the location- 
information acquisition apparatus 66, and sends a deletion request together with the obtained 
location information to the virtual -object management apparatus 100 through steps S202 and 
S204. 

[0175] When the virtual-object management apparatus 1 00 receives the deletion 
request, the apparatus receives the location information, and searches the virtual-object 
management table 400 according to the received location information for the corresponding 
object information through steps S208 and S210. In this case, the object information of the 
virtual objects A and B is found. 

[0176] Then, a list of virtual objects to be deleted is generated according to the 
found object information, and the generated list of virtual objects is sent to the virtual-object- 
setting apparatus 200 through steps S21 1 and S212. 

[0177] When the virtual-object-setting apparatus 200 receives the list of virtual 
objects, the apparatus displays the received list of virtual objects through step S216, and 
requests the user to select a virtual object to be deleted. In response to the selection request, 
the user selects, for example, the virtual object A. 

[0178] When the object to be deleted is selected, the virtual-object-setting apparatus 
200 sends a deletion request and a deletion object of the virtual object A to the virtual-object 
management apparatus 1 00 through step S220. 

[0179] When the virtual-object management apparatus 100 receives a deletion 
object of the virtual object A and the deletion request, the apparatus deletes the object 
information and the service information of the virtual object selected as an object to be 
deleted, through step S224. When the virtual-object management apparatus 100 receives a 
termination request from the virtual-object-setting apparatus 200, the apparatus sends a 
deletion-completion notice to the virtual-object-setting apparatus 200. 

[0180] When the virtual-object-setting apparatus 200 receives the deletion- 
completion notice, the apparatus displays a message indicating that the virtual object has been 
deleted, through step S236. 

[0181] A case in which a virtual object is updated will be described next. 

[0182] A staff member of the art museum uses the virtual -object-setting apparatus 
200 to update a virtual object. The staff member first moves to a place where the virtual 
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objects A and B have been specified, and instructs the virtual-object- setting apparatus 200 to 
update the virtual objects. 

[0183] When the virtual-object-setting apparatus 200 receives a user instruction of 
the update of the virtual objects, the apparatus receives location information from the 
location-information acquisition apparatus 66, and sends an update request together with the 
obtained location information to the virtual-object management apparatus 100 through steps 
S302 and S304. 

[0184] When the virtual -object management apparatus 100 receives the update 
request, the apparatus receives the location information, and searches the virtual-object 
management table 400 according to the received location information for the corresponding 
object information through steps S308 and S3 10. In this case, the object information of the 
virtual objects A and B is found. 

[0185] Then, a list of virtual objects to be updated is generated according to the 
found object information, and the generated list of virtual objects is sent to the virtual-object- 
setting apparatus 200 through steps S3 1 1 and S3 1 2. 

[0186] When the virtual-object-setting apparatus 200 receives the list of virtual 
objects, the apparatus displays the received list of virtual objects through step S3 16, and 
requests the user to select a virtual object to be updated. In response to the selection request, 
the user selects, for example, the virtual object B as an object to be updated, and inputs an 
update content for the virtual object B, selected. 

[0187] When the object to be updated is selected and the update content is input, the 
virtual-object-setting apparatus 200 generates object information and service information 
according to the obtained location information, and the selection result and the input result of 
steps S320 and S322, and sends the generated object information and the generated service 
information to the virtual-object management apparatus 100 together with an update object of 
the virtual object B and a update request, through steps S324 and S326. 

[0188] When the virtual-object management apparatus 100 receives an update 
object of the virtual object B and the update request, the apparatus receives the object 
information and the service information, and updates the object information and the service 
information of the virtual object selected as an object to be updated, according to the received 
object information and the received service information, through steps S330 and S332. Then, 
when the virtual-object management apparatus 100 receives a termination request from the 
virtual-object-setting apparatus 200, the apparatus sends an update-completion notice to the 
virtual-object-setting apparatus 200 through step S340. 
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[0189] When the virtual-object-setting apparatus 200 receives the update- 
completion notice, the apparatus displays a message indicating that the virtual object has been 
updated, through the step S344. 

[0190] As described above, in the present embodiment, the virtual-object 
management apparatus 100 associates object information related to the shape and the location 
of a virtual object with service information and stores them, and sends the object information 
and the service information stored in the virtual-object management DB 42 to the digital 
camera 300 in response to a transmission request sent from the digital camera 300. When the 
digital camera 300 determines from the obtained location information and the received object 
information that the digital camera 300 is disposed in the inside area of the virtual object 
identified by the shape and location of the virtual object, the camera executes an action 
corresponding to the virtual object, according to the received service information. 

[0191] With these operations, a virtual object has a shape and a location, and it is 
determined whether the digital camera 300 is disposed in the inside area of the virtual object. 
Since an area where service is provided is relatively clarified compared with a conventional 
case, different services can be provided in fine units, such as in units of several meters. In 
addition, since an area where service is provided is not a point but has a predetermined range, 
the user is more likely to receive the service. 

[0192] Further, in the present embodiment, the virtual-object management 
apparatus 100 associates object information with service information which specifies the 
contents of an action of the digital camera 300 and stores them. When the digital camera 300 
determines according to obtained location information and received object information that 
the digital camera 300 is disposed in the inside area of a virtual object, capturing with the use 
of the digital camera 300 is prohibited according to received service information. 

[0193] With these operations, since the operation of the digital camera 300 is 
controlled according to the movement of the user, not only an information providing service 
but a variety of services can be received. In the present embodiment, the art museum 
receives a service of capturing prohibition. 

[0194] In addition, in the present embodiment, the virtual-object management 
apparatus 100 performs an input related to creation, deletion, or update of object information, 
according to communication with the virtual-object-setting apparatus 200, and creates, 
deletes, or updates object information according to the contents of the input. 
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[0195] Therefore, since it becomes easier to create, delete, or update virtual objects, 
the art museum can relatively flexibly handle a change in situation, such as a location shift of 
an exhibition or an increase or decrease of the number of exhibitions. 

[0196] Further, in the present embodiment, the digital camera 300 performs the 
analysis processing of object information. Therefore, the processing load of the virtual-object 
management apparatus 1 00 is reduced. 

[0197] Furthermore, in the present embodiment, the digital camera 300 executes an 
action. Therefore, the processing load of the virtual -object management apparatus 100 is 
reduced. 

[0198] In the above embodiment, the analysis processing of object information is 
performed by the digital camera 300. However, it should be understood that the 
configuration is not limited to this case. The analysis processing of object information may 
be performed by the virtual-object management apparatus 1 00. 

[0199] In this case, the processing load of the digital camera 300 is reduced. 

[0200] In the above embodiment, the execution of an action is performed by the 
digital camera 300. However, it should be understood that the configuration is not limited to 
this case. The execution of an action may be performed by the virtual-object management 
apparatus 100. 

[0201] In this case, the processing load of the digital camera 300 is reduced. 

[0202] In the above embodiment, one action is associated with one virtual object. 
However, it should be understood that association is not limited to this case. A plurality of 
actions (actions of capturing prohibition and indication of a description in the above 
embodiment) may be associated with one virtual object. 

[0203] In the above embodiment, the present invention is applied to a case in which 
capturing pictures is prohibited in an art museum. The following variations can be proposed. 

[0204] In a first variation, when an action of printing at a printer is associated with a 
virtual object, and the virtual object is virtually disposed in an area which includes the 
printer, for example, when a person who carries the digital camera 300 approaches the 
printer, capturing data of the digital camera 300 is automatically printed. In this case, if a 
confirmation and a response are sent to and from the user of the digital camera 300 before 
printing, it is more convenient. 

[0205] In a second variation, when an action of displaying an advertisement is 
associated with a virtual object, and the virtual object is disposed, for example, at an entrance 
of a building having a shopping mall, if a person having a portable telephone having the 
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fiinction of the above digital camera passes through the entrance of the building, an 
advertisement of a shop in the shopping mall can be displayed on the portable terminal. 

[0206] In the above embodiment, when the digital camera 300 determines 
according to the interpretation result of step S414 that the digital camera 300 is not disposed 
in the inside area of a virtual object, capturing prohibition is released. Release of capturing 
prohibition is not limited to this case. When a viewer goes away from the inside area of a 
virtual object, if the digital camera 300 receives a notice telling that object information does 
not exist, from the virtual-object management apparatus 100, capturing prohibition may be 
released. 

[0207] In the above embodiment, virtual objects are set in a fixed manner. Setting 
of a virtual object is not limited to this case. A virtual object may be set in a movable 
manner. A virtual object can be set so as to appear or disappear according to a time 
condition. For example, a virtual object appears at a predetermined place at a predetermined 
time, makes a predetermined movement, and when a predetermined period elapses from that 
point of time, the virtual object disappears. Therefore, a change in condition in terms of 
place and time can be handled in a relatively flexible manner. 

[0208] In the above embodiment, object information and service information are 
transmitted and received by radio. A transfer method is not limited to this case. The 
information may be transferred through a network. Alternatively, the information is stored in 
a storage medium, such as an IC-card chip or a two-dimensional bar code, and transferred 
through it. 

[0209] In the above embodiment, the digital camera 300 stores in advance a 
program (corresponding to processing shown in Fig. 14) for interpreting object information 
and service information. Interpretation of the information is not limited to this case. The 
object information and the service information may be interpreted in a way in which the 
digital camera 300 does not have such a program, the virtual-object management apparatus 
100 includes the program in the object information and sends them, the digital camera 300 
only gives location information to the received program, and the program is executed to 
interpret the object information and the service information. 

[0210] Therefore, a new service can be received just by modifying the program of 
the virtual-object management apparatus 100 without changing the internal setting of the 
digital camera 300. 

[0211] In the above embodiment, object information and service information are 
stored in the virtual-object management apparatus 100. However, it should be understood 
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that storage of the information is not limited to this case. The object information and the 
service information may be stored in different apparatuses with the virtual-object 
management apparatus 100 storing only access information (such as short cuts) for accessing 
the information. In this case, the digital camera 300 obtains the access information from the 
virtual-object management apparatus 100, and obtains the object information and the service 
information according to the access information. 

[0212] In the above embodiment, service is provided by actions of capturing 
prohibition and an indication of a description. However, it should be understood that the 
service is not limited to this case. Notice information related to a notice, or guidance 
information related to a guidance may be provided. 

[0213] In the above embodiment, the digital camera 300 and the virtual-object- 
setting apparatus 200 cooperate to provide the service. However, it should be understood that 
the structure is not limited to this case. With the use of a projector, a printer, a personal 
computer, an audio unit, a scanner, a PDA, a portable telephone, a watch-type PDA, or a 
point-of-sale (POS) terminal instead of the digital camera 300, the used unit and the virtual- 
object-setting apparatus 200 may cooperate to provide the service. 

[0214] When a projector is used, a virtual object is formed, for example, at the 
projector or near the projector. When it is determined that a mobile member, such as a card 
or a portable telephone, is disposed in the inside area of the virtual object, projection service 
is provided by the projector. When a printer, a personal computer, a scanner, an audio unit, 
or a POS terminal is used, service unique to the used unit can be provided in the same manner 
as for the projector. 

[0215] When a PDA is used, when it is determined that the PDA is disposed in the 
inside area of a virtual object formed at a place, predetermined service is provided in the 
same manner as for the digital camera 300 used in the above embodiment. When a portable 
telephone or a watch-type PDA is used, predetermined service can be provided in the same 
manner as for the PDA. 

[0216] In the above embodiment, control programs stored in advance in the ROMs 
32, 52, and 72 are executed to perform the processing shown in the flowcharts of Fig. 5 to 
Fig. 8, Fig. 10 to Fig. 12, and Fig. 14. However, it should be understood that execution of the 
processing is not limited to this case. Programs showing the procedures, stored in storage 
media may be read into the RAM 34, 54, and 74 for execution. 

[0217] The storage media include any recording media, such as semiconductor 
media, including a RAM and a ROM; magnetic storage media, including a floppy disk and a 
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hard disk; optical-reading storage media, such as a CD, a CDV, an LD, and a DVD; and 
magnetic-storage/optical-reading storage media, including an MO, which can be read by 
computers irrespective of reading methods, such as an electronic method, a magnetic method, 
and an optical method. 

[0218] In the above embodiment, a service providing system, a management 
terminal, a mobile member, a service providing program, and a service providing method 
according to the present invention are applied to a case in which, as shown in Fig. 1 and Fig. 
2, the virtual-object-setting apparatus 200 disposes and sets the cubic virtual objects A and B 
in front of the pictures A and B exhibited on a wall surface in the art museum, and capturing 
by the use of the digital camera 300 is prohibited in the inside areas of the virtual objects A 
and B. However, it should be understood that application of the present invention is not 
limited to this case. The present invention can also be applied to other cases without 
departing from the spirit and scope of the present invention. 

[0219] As described above, according to service providing systems specified in the 
present invention, a virtual object has a shape and a location, and it is determined whether the 
mobile member is disposed in the inside area of the virtual object. Since an area where 
service is provided is relatively clarified compared with a conventional case, different 
services can be provided in fine units, such as in units of several meters. In addition, since an 
area where service is provided is not a point but has a predetermined range, the user obtains 
an advantage of being more likely to receive the service. 

[0220] Further, according to a service providing system specified in the present 
invention, since the management terminal makes a determination, an advantage is also 
obtained in which the processing load of the mobile member is reduced. 

[0221] Further, according to a service providing system specified in the present 
invention, since the mobile member makes a determination, an advantage is also obtained in 
which the processing load of the management terminal is reduced. 

[0222] Further, according to a service providing system specified in the present 
invention, since the management terminal provides service, an advantage is also obtained in 
which the processing load of the mobile member is reduced. 

[0223] Further, according to a service providing system specified in the present 
invention, since the mobile member provides service, an advantage is also obtained in which 
the processing load of the management terminal is reduced. 

[0224] Further, according to a service providing system specified in the present 
invention, since it becomes easier to create, delete, or update virtual objects, an advantage is 
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obtained that a change in situation, such as a construction of a new solid body, including a 
building, application to a solid body which is only temporarily located, including an 
exhibition, or information transfer between users, can be relatively flexibly handled. 

[0225] Further, according to a service providing system specified in the present 
invention, an advantage is obtained that not only information providing service but a variety 
of service can be received. 

[0226] Further, according to a service providing system specified in the present 
invention, an advantage is obtained that not only information providing service but a variety 
of service can be received. 

[0227] Further, according to a service providing system specified in the present 
invention, since it becomes easier to create, delete, or update virtual objects, an advantage is 
obtained that a change in situation, such as a construction of a new solid body, including a 
building, application to a solid body which is only temporarily located, including an 
exhibition, or information transfer between users, can be relatively flexibly handled. 

[0228] According to a management terminal specified in the present invention, the 
same advantage as that obtained from the service providing system specified in the present 
invention is obtained. 

[0229] According to a mobile member specified in the present invention, the same 
advantage as that obtained from the service providing system specified in the present 
invention is obtained. 

[0230] According to a service providing program specified in the present invention, 
the same advantage as that obtained from the service providing system specified in the 
present invention is obtained. 

[0231] According to a service providing program specified in the present invention, 
the same advantage as that obtained from the service providing system specified in the 
present invention is obtained. 

[0232] According to a service providing program specified in the present invention, 
the same advantage as that obtained from the service providing system specified in the 
present invention is obtained. 



